ACEEEInt. J. on Control System and Instrumentation, Vol. 03, No. 01, Feb 2012 



System Identification in GSM/EDGE Receivers Using 

a Multi-Model Approach 

Taimoor Abbas', and Fredrik Tufvesson 2 
Department of Electrical and Information Technology, Lund University Sweden 
Email: 1 taimoor.abbas@eit.lth.se, 2 fredrik.tufvesson@eit. lth.se 



Abstract — Model order selection is an important element in 
system identification. It is well known that common model 
order selection methods such as Akaike's information 
criterion (AIC) and Bayesian's information criterion (BIC) 
neglect relevant information that is available in models of 
order different from the one chosen. In this paper the model 
order selection problem for receivers similar to those found 
in GSM and EDGE systems is reviewed briefly and is solved 
with a multi-model approach based on simultaneous 
consideration of several models. Two methods are evaluated; 
a multi-model noise suppression filter and multi-model soft 
combining. The algorithms are implemented and evaluated 
by means of simulations. The performance of each method is 
analyzed for GSM and EDGE receivers in a link level 
simulator. Simulation results show a significant improvement 
in performance at the cost of increased computational 
complexity for the multi-model approach. 

Index Terms — System Identification, Multi-model, GSM, 
EDGE, Whitening, Equalizer 

I. Introduction 

The benefits of using parametric models for system 
identification have been recognized for several decades in 
the area of artificial intelligence, pattern recognition, 
stochastic modeling, signal processing, and digital 
communications. The equalizers in modern digital 
communication receivers, such as GSM and EDGE, utilize 
discrete model structures, e.g., discrete time finite-impulse- 
response (FIR) filter and/or autoregressive (AR) processes. 
The parameters of these models, including the model order, 
are typically estimated adaptively to reflect the varying radio 
conditions [ 1 ] . Clearly, just like any other model parameter, 
the choice of model order will affect the system performance 
considerably and is therefore an important area of research. 
The more commonly used model order selection methods, 
including Akaike's information criterion (AIC) derived using 
Kullback-Leibler (KL) information and Bayesian's information 
criterion (BIC), are based on maximum-likelihood (ML) 
estimation principle (see e.g., [2]-[6]). BIC is preferred over 
AIC when A r is small, where is model order, but asymptotically 
they are equivalent, i.e., when or [6]. Unfortunately, AIC and 
BIC are prone to under-estimating and over-estimating the 
model order and are known to neglect relevant information 
that may be available in models of order different from the 
one chosen. To exploit this knowledge, a new composite 
method based on the simultaneous consideration of several 
models of different orders, the so-called multi-model approach 
has recently been introduced in [7]. In this work, we apply the 
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multi-model approach of [7] to equalizers similar to those 
found in GSM and EDGE receivers. We evaluate a two-step 
approach, where in the first step, we apply the multi-model 
approach to the noise model of [7] to estimate a hypothesized 
multi-model noise whitening filter. In the second step, we 
combine the soft-outputs, which are obtained by the soft- 
output Viterbi algorithm (SOVA) [9], from several parallel 
equalizers with different channel lengths. The idea of multi- 
model soft combining was first presented in [10] for multi- 
user detection problem with somewhat different approach 
and was later extended in [1] to get the multi-model soft 
outputs. The performance of the multi-model whitening filter 
and multi-model SOVA are compared against an adaptive 
length whitening filter and single model SOVA with channel 
length estimation, respectively. The evaluations are 
performed in a link-level simulator for different propagation 
models; static, rural, typical urban and hilly terrain at different 
terminal speeds of 1, 3, 50, 100 and 250 km/h. The simulator 
considers both the co-channel and adjacent channel 
interference. The simulation results for GSM/EDGE receivers 
with a single antenna branch and two antenna branches are 
presented. Results for two diversity combining schemes [11], 
Maximum Ratio Combining (MRC) and Interference Rejection 
Combining (IRC) are compared for the receivers having two 
antenna branches. The results show that the multi-model 
whitening filter provides low gain for the single branch 
receivers but there is significant gain in the two branch 
receivers. However, an equalizer with multi-model soft 
combining outperforms the ordinary adaptive length equalizer 
for both single and multiple branch receivers. This high gain 
is achieved at the cost of increased computational complexity. 

II. MULTI-MODEL SYSTEM IDENTMC ATION FOR GSM/ 
EDGERECErVERS 

A. The Multi-model Approach 

In most model selection processes, information criteria 
such as AIC and BIC, as mentioned above, are often used to 
select the model order for further processing. The simplified 
expression for the AIC rule is given as [6] 



m!n ;e[!«ii w ;* 11 }[ /,/(: = ~ 2 ^(likelihood) +■ 2i] : 
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where ; is the number of independently adjusted parameters, 
i.e., model order in our case. Model order using BIC can be 
obtained in the same way as AIC with simple approximation 
given in [6] as, 
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min [BIC = -21n(ii±«Wuwwf) + GnW)L (2) 

In general, it is hard to make a good estimate of the model 
order. When using single model selection we only choose 
one model order and neglect other possibilities. The multi- 
model approach [7] for model-order selection is designed to 
deal with this problem. In multi-model model-order selection 
the AIC or BIC is used to estimate the a posteriori probabilities 
associated to each model w.r.t. training data, and the output 
of several models can finally be combined using a weighting 
function. The multi model approach is investigated for BIC in 
[6], but it is also stated that these conclusion are applicable 
to AIC more or less directly. The AIC rule for multi-model 
selection can be obtained in the following way. Let y be the 
observed data vector. The a posteriori probability of data 
can be approximated as 



(3) 



where k is a constant, and Mi represents the hypothesis that 
a certain model with order I e [0, L] has generated the data 
y. Assuming all the models are a priori equally probable, i.e., 
P(M: ) is a constant, we can write the Bayesian rule as, 

F(y| Mj}J(Mi} (4) 



P(M E \y) =■ 



«P r.MfJ 

Using (3) in (4) and if 8 = — : — is constant. We get, 



p(M ; |y) ft* fie~~^~. 
The constant in (5) can be obtained as, 

Alu k 



(5) 



(6) 



Using (6) in (5) gives the estimte of a posteriori probability 
of model obtained by AIC as, 



P(M,|y) 



'■k=o e *■ 
Otherwise 



Hence, by means of a posteriori probabily j>(jVf- iyjl the multi- 
model estimate of parameter vector is given as (for details 
see [7]), 



0*» = P{M \y~y8 + PCM, |y)fl 1 + 



(8) 



5. Multi-model Noise Suppression 

Let £ be the n rfc received data vector. After the 
synchronization and least square channel estimation [8] the 
system model of the received data vector can be interpreted 

as 



(9) 



where W is a (cJ x 1} residual vector representing noise and 
interference together, and (d X d) matrix ^"modeling channel 
transfer function is estimated by the channel estimator. 

Typically one passes Z ^ through a whitening filter to make 
the interference temporally uncorrelated. The reference 
receiver of GSM/EDGE is shown in Fig.l. The system 
simulator models W as vector auto-regressive (VAR) process 
with model order [ e lO., L\ The difference equation of a VAR 
process of order t can be written as 

(10) 



IV, = -A a I-K,_ a 



where A v A 2 , • . . , A L are (d x d"j matrices of the VAR process 
and Em is an error vector with zero mean and covariance Q, 
i.e., Q = E^lS^s^ 1 -- The whitening filters in the reference 
receivers select the filter length I g IOj i] adaptively using 
AIC and then estimate the filter coefficients using the Yule- 
Walker equation (see [12] and [13]). In this contribution, we 
replace the adaptive whitening filter with a multi-model 
whitening filter which estimates the filter coefficients for VAR 

models of every order, i.e., f = 0,1 L and weight them 

together according to their a posteriori probabilities. The 
block diagram of the modified whitening filter is shown in the 
Fig. 2. We compare the results of multi-model whitening filter 
against adaptive length selection based whitening filter in 
reference receivers. If the VAR- model is driven by complex 
valued white Gaussian noise, then the estimated parameter 
vector § L will have L+l coefficient matrices, i.e., 
9 L = [A A t ... A L ] each containing complex parameters. 
Considering that is ) identity matrix, the estimated parameter 
vector for VAR process of order using multi-model approach 
can be obtained using (8) as follows, 

&Ln = L^d 0... 0\P(M n \y) + [A a A t ... OjfOlfJy) (1 1) 
+ -+[A D i 1 ... A L ]P(M L \y). 

The always has £ + 1 coefficient matrices where £■ is 
the highest permissible model order. The probability p(M- \y~) 
in (8) is estimated by using the simplified AiC; derived 
explicitly for the VAR process as 

(12) 



.v 



A1Q =logdc,|) + d(\ogn+ 1) + 

where C- is the covariance matrix. The multi-model coefficients 

@rrn are men usec ^ as me coefficients of the multi-model 
whitening filter. 
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Fig.l. Block Diagram of Reference GSM/EDGE Receivers 
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C. Multi-model Soft Combining 

The Viterbi algorithm in our simulator keeps track of the 
most likely path sequences through the state trellis but it is 
modified to provide also the reliability information or soft 
value for each bit in the form of log-likelihood ratios (LLRs) 



TABLE I. THE DATA RATE AND MODULATION TYPE FOR EACH OF MODULATION AND 
CODING SCHEMES MCSl-MCS9 



Yk = log 



(13) 



whereas P[b k = -l|Z n }and P[b b = -l|Z„] are 
loglikelihood ratios (or a posteriori probabilities) with respect 
to received data jj that a certain information bit b-^ is +1 
or— lis transmitted. The algorithm used to compute the softs 
is called Soft Output Viterbi Algorithm (SOVA) [9]. In the 
reference GSM and EDGE receivers the equalizer adapts to 
most likely channel length such that the mean squared error 
is minimized. It gives the soft decision y- A ^ for a certain 
information bit b-^ conditioned on channel length £ as (12), 

with the assumption that ; e [lrrSr>> ^rr.cx] * s * rue channel 
length estimate. If the estimated is not the true channel length 
then the soft decisions can be inappropriate and lead to high 
error probability. This problem can be solved by a multi-model 
methodology, by running several equalizers in parallel for all 
possible channel lengths and combining the output in an 
optimum way (for details see [1]). The block diagram for multi- 
model soft combining which we implement is shown in Fig. 3. 
We estimate the soft values for all possible channel lengths 
and combine them with the estimated model order a posteriori 
probabilities. The multi-model SOVA with model weighting 
can be written as, 

Yk = log ; 



i - s; majf p(M 

'itilti 



i\y) 1 + e rk\i 



(14) 



Fig. 2 Block Diagram of Multi-Model Whitening Filter 

The multi-model soft outputs calculated above are given to 
the decoder to obtain the data sequence. Since we are running 
more than one equalizer it is obvious that the complexity of 
the receivers will increase. 

HI. TEST SCENARIOS AND SIMULATION 
PARAMETERS 

The algorithms are evaluated for a number of test cases 
for the performance evaluation. These test cases include 
various types of propagation models, interference formats, 
modulation and coding schemes and receivers with single 
antenna or two antenna branches. The reference receivers 
are adaptive based on single model selection. 
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A. Modulation and Coding Schemes 

The modulation and coding schemes tested are MCS1- 
MCS9 as listed in Table I and the results for MCS1, MCS3, 
MCS6, and MCS8 are presented in section IV. 

B. Propagation Models 

The propagation models are defined in Table II according 
to [14]. Channel models including Hilly Terrain (HT), Rural 
Area (RA) and Typical Urban (TU) are analyzed. Terminals 
moving with low speed (3 km/h and 50 km/h) and high speed 
( 1 00 km/h and 250 km/h) are tested with and without frequency 
hopping respectively. 

C. Receiver Types and Interference Formats 

Receivers with one and two branches are tested for each 
of the above modulation and coding schemes. The Maximum 
Ratio Combining (MRC) and the Interference Rejection 

tableii. Propagation Models Under test 



Propagation Model 


Terminal 
5p5sd(Km\h) 


Frequency 
HoppinE 


Static 


1 


No 


Typical Urban (TU) 


3 


Yes 


Tvpical Urban (TU) 


5: 


Yes 


Hilly Terrain (HT) 


:zz 


Xc 


Rural Area (RA) 


250 


No 



Combining (IRC) is taken into account for the receivers having 
two antenna branches. The multi-model algorithms evaluated 
both for the receivers without diversity and the receivers 
with diversity (MRC/IRC). All the above mentioned test cases 
are studied and the obtained results are summarized in Section 
IV. The results are achieved by simulating the different 
algorithms for 10,000 radio bursts. The simulations are run 
for both the interference limited and noise limited scenarios. 
In the interference limited scenarios Signal to Noise ratio 
(Eb/No) is set to 45 dB and the performance is evaluated for 
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TABLE HI. MULTI-MODEL WHITENING FILTER WITH CO-CHANNEL AND CO-CHANNEL 
MULTIPLE INTERFERENCE 

Receiver Mode Speed Performance Gain for 

Type 1 {Knvh) 10% BLER (dB) 

mcs mcs mcs mcs 
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z 



Whitening filter of length 3 is compared against the adaptive 
length whitening filter. The simulation results show that the 
multi-model noise suppression filter has better performance 
for both the single branch receiver and the two branches 
MRC based receiver (see Tables III and IV). 

TABLE IV. MULTI-MODEL WHITENING FILTER WITH ADJACENT CHANNEL INTERFERENCE 

Receiver » . Speed Performance Gain for 

Type (Kmh) 10% BLER (dB) 

MCS MCS MCS MCS 
13 6 3 

TU 3 -06 -05 -11 -OS 
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different Carrier to Interference ratios (C/I). Several 
interference formats are investigated, e.g., co-channel 
interference, multiple co-channel interference, and the 
adjacent channel interference. 
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Fig. 3. Block Diagram of Multi-Model Softs Combining 

The noise limited scenarios (sensitivity tests) are tested for 
completeness where the C/I ratio is set to 1000 dB and the 
performance is evaluated for different Eb/No. For the 
sensitivity test it is assumed that there is no interference and 
the noise is AWGN. 

IV NUMERICAL EXAMPLES 

Due to space limitation the simulation results are 
summarized only for 10% Block Error Rate (BLER) and are 
categorized according to different interference formats in the 
following sub sections. 

A. Example 1: Multi-model Whitening Filter 

First of all the model order selection is reviewed and the 
comparison is made between the classical AIC of (1) and the 
modified AIC of ( 1 1 ). From the results it is observed that that 
the modified AIC is more appropriate choice for model order 
selection. Hence modified AIC is used to calculate the model 
weights. The adaptive filter's length varies from 1 to 3 
depending upon the type of interference. Hence a multi-model 
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However, the multi-model noise suppression degrades the 
performance for the single branch receiver in the presence of 
adjacent channel interference; the reason for this degradation 
in performance could be due to under/over fitting the model 
order. The multi-model noise suppression filters show no 
gain in case of IRC because in IRC "the gain" has already 
been achieved with other algorithm, i.e., spatio-noise de- 
correlation. 

B. Example 1: Multi-model Soft Combining 

The multi-model soft outputs with model weighting are 
obtained by combining soft outputs from five parallel 
equalizers. As the adaptive equalizers under study select the 
channel length adaptively from f ( taps up to a maximum of 
l Vct ta P s ' we modified these receivers such that they run 
equalizations for five channel lengths in parallel and combine 
the soft outputs obtained from each of these equalizers. These 
multi-model equalization based receivers are compared against 
the adaptive equalization based receivers. The detailed 
comparison of all these methods and relative gains for 10% 
BLER is summarized in Tables V and VI. The results show 
that the multi-model soft combining outperform the ordinary 
adaptive length equalization. A significant gain is obtained 
at the cost of increased computational complexity. The idea 
behind mixing multi-model soft values is to take all the possible 
channel lengths into account so that any information 
associated to certain channel length is not missed. To reduce 
the computational complexity, instead of considering all 
possible channel lengths one can think of combining soft 
values only from the most effective lengths, i.e., models having 
highest weights. Hence, for sake of comparison, from five 
parallel equalizers we select only two equalizers that carry 
highest weights and combine their softs with multi-model 
approach. When the results for five parallel equalizers are 
compared against two equalizers carrying highest a posteriori 
probabilities it is observed that difference in performance is 
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TABLE V. SOFT COMBINING WITH ADJACENT CHANNEL INTERFERENCE; FIVE PARALLEL 
EQUALIZERS 

Rscsivsr »x. , Speed Performance Gain for 

Type (Km/h) 10% BLER (dB) 
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relatively small. It is not possible to show all the comparison 
results due to lack of space however sample results are shown 
in Fig. 4. For complete results see [ 15] . 



TABLE VI. SOFT COMBINING WITH CO- CHANNEL INTERFERENCE; FIVE PARALLEL 
EQUALIZERS 
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V. SUMMARY AND CONCLUSIONS 

The paper focuses on multi-model system identification 
in GSM/EDGE receivers. This approach is adapted to reduce 
the overall identification error. For this purpose the related 
information from each model is used in proportion to their 
weights or a posteriori probabilities. Akaike's information 
criterion (AIC) is used to obtain the weight of each model. 
The multi model identification based equalizers are 
implemented for receivers with one antenna and two antenna 
branches (MRC/IRC) respectively. It is observed that the 
performance is gained at the cost of increased complexity. 




Fig. 4. BLER compaiison plot for different soft combining 
methods; receiver is MRC based with GMSK modulation tested for 
rural scenario with terminal speed of 250 Km/h 

The center of attention in this paper was the performance 
evaluation against single model identification based refer- 
ence receivers. The performance is evaluated by means of 
simulations under different modulation and coding schemes 
(MCSs), numerous interference formats and propagation 
models. The simulation results show that the multi-model 
noise suppression filters have better performance for single 
branch receiver and the two branches MRC based receiver. 
Whereas the IRC based receivers and the multi-model noise 
suppression filters have almost the same performance gain. 
An adaptive equalizer is suboptimal if the estimated channel 
length is incorrect. On the other hand a multi-model equalizer 
takes care of all permissible channel lengths according to their 
weights thus chances of losing relative information by 
adaptively selecting an inappropriate channel length can be 
reduced. From the simulation it is observed that the multi- 
model soft combining outperformed the adaptive equalizer. 
An effective gain has been achieved for all the propagation 
models and interference formats with an increase in computa- 
tional complexity. Finally, it is suggested that the computa- 
tional complexity can be reduced if we combine the softs only 
from the most appropriate channels instead of all permissible 
channels. Therefore soft outputs from two parallel equalizers 
are combined. Simulation results show that the computational 
complexity has been decreased with almost the same perfor- 
mance as with the five parallel equalizers. 
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